Multiple comparison procedures applied to model selection
نویسندگان
چکیده
This paper presents a new approach to model selection based on hypothesis testing. We 4rst describe a procedure to generate di5erent scores for any candidate model from a single sample of training data and then discuss how to apply multiple comparison procedures (MCP) to model selection. MCP statistical tests allow us to compare three or more groups of data while controlling the probability of making at least one Type I error. The complete procedure is illustrated on several model selection tasks, including the determination of the number of hidden units for feed-forward neural networks and the number of kernels for RBF networks. c © 2002 Elsevier Science B.V. All rights reserved.
منابع مشابه
Selection of Variables that Influence Drug Injection in Prison: Comparison of Methods with Multiple Imputed Data Sets
Background: Prisoners, compared to the general population, are at greater risk of infection. Drug injection is the main route of HIV transmission, in particular in Iran. What would be of interest is to determine variables that govern drug injection among prisoners. However, one of the issues that challenge model building is incomplete national data sets. In this paper, we addressed the process ...
متن کاملA statistical model selection strategy applied to neural networks
In statistical modelling, an investigator must often choose a suitable model among a collection of viable candidates. There is no consensus in the research community on how such a comparative study is performed in a methodologically sound way. The ranking of several methods is usually performed by the use of a selection criterion, which assigns a score to every model based on some underlying st...
متن کاملA Comprehensive Fuzzy Multiobjective Supplier Selection Model under Price Brakes and Using Interval Comparison Matrices
The research on supplier selection is abundant and the works usually only consider the critical success factors in the buyer–supplier relationship. However, the negative aspects of the buyer–supplier relationship must also be considered simultaneously. In this paper we propose a comprehensive model for ranking an arbitrary number of suppliers, selecting a number of them and allocating a quota o...
متن کاملPairwise multiple comparisons: a model comparison approach versus stepwise procedures.
Researchers in the behavioural sciences have been presented with a host of pairwise multiple comparison procedures that attempt to obtain an optimal combination of Type I error control, power, and ease of application. However, these procedures share one important limitation: intransitive decisions. Moreover, they can be characterized as a piecemeal approach to the problem rather than a holistic...
متن کاملA Fuzzy Based Mathematical Model for Vendor Selection and Procurement Planning with Multiple Discounts in the Presence of Supply Uncertainty
Supplier selection and material procurement planning are the most important issues in supply chain management. This decision is complicated when the buyers face with discount price schemes. In real situation, each supplier may apply different methods such as different types of discount schedules and various types of payment in order to increase market share. In this situation, buyers try to sel...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neurocomputing
دوره 48 شماره
صفحات -
تاریخ انتشار 2002